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^ (57) Abstract: A system and method for recording and/or otherwise monitoring IP multimedia sessions. The present invention 
2 features a recording and/or monitoring device, referred to hereinafter as "a recording device" for the purposes of clarity only and 
without any intention of being limiting. The recording device is a participant in the IP multimedia session, although preferably the 
Q recording device only receives data for recording and/or otherwise monitoring the session. Therefore, the TP multimedia session is 
^ preferably a multi-user session, such as a "conference call" for example, even if data is being provided for recording from only one 
^ of the participants in the session. 
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DIGITAL RECORDING OF IP BASED 
DISTRIBUTED SWITCHING PLATFORM 

FIELD OF THE INVENTION 
5 The present invention relates to a system and a method for recording voice and other data 

passed through IP multimedia sessions, and in particular, for such a system and method in which 
recording is triggered with the recording device as a participant in the session. 

BACKGROUND OF THE INVENTION 

10 Teleconmiunication is an important aspect of interactions between individuals, as it 

enables individuals to communicate without being physically present in the same location, thereby 
potentially increasing the possibilities for cooperation between such individuals. Simultaneously, 
an increa^ng number of telecommunication sessions are being monitored and/or recorded, for 
example for quality assurance at a "help desk" or other customer support center or service. 

15 Previously, such monitoring or recording was relatively simple in the background art. For 

example, telephone calls may typically be passed to the individual through a PBX (public 
exchange) switch or CO (central office), which features a central switching matrix. All telephone 
calls passing this switch would therefore pass through the central matri?^ such that integration of 
the recording and/or monitoring equipment with the central matrix would ^ble all such 

20 telephone calls to be recorded and/or monitored. 

Unfortunately, monitoring and/or recording such telephone calls through the P 
multimedia session protocols is not as simple. First, the session is multimedia, such that it may 
combine two or more different types of data. Second, the session does not pass through a central 
switchmg matrix, as IP communication does not feature such a matrix. Thus, such 

25 communication is relatively difiuse, even across a WAN (wide area network) or LAN (local area 
network). 

The situation is further complicated by the topology of the IP network, which consists of 
switch boxes, routers and bridges, and wluch may prevent any recording and/or monitoring 
system from accessing such communication sessions that are routed on different network 
30 segments. In addition, encrypted sessions add a further element of complexity, as access to such 
sessions is typically only granted to participants, as only participants have access to the necessary 
information to decrypt the encrypted session. 
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SUMMARY OF THE INVENTION 

The background art does not teach or suggest a sohition to the probl^ of collecting 
information about an interactive session over an P network. The background art also does not 
5 teach or suggest a solution to the problem of monitoring and/or recording IP multimedia sessions. 
In addition, the background art does not teach or suggest a solution to the problem of monitoring 
and/or recording IP multimedia sessions that are routed on different network segments. 

The present invention overcomes these problems of the background art by providing a 
system and method for recording and/or otherwise monitoring IP multimedia sessions. The 
10 present invention features a recording and/or monitoring device, referred to hereinafter as "a 
recording device'' for the purposes of clarity only and without any intention of being limiting. 
The recording device is a participant in the IP multimedia session, although preferably the 
recording device only receives data for recording and/or otherwise monitoring the sessioiu 
Therefore, the IP multimedia session is preferably a multi-user session, such as a ""conference call" 
15 for example, even if data is being provided for recording from only one of the participants in the 
sessioa This implementation of the present invention, as described in greater detail below, 
overcomes such drawbacks of the background art as the inability to otherwise decrypt encrypted 
sessions, and recording across network segments. 

Hereinafter, the term "separate network portion" includes any separate portion or network 
20 across which recording is performed, such as a different network segment and/or network for 
example. 

According to a preferred embodiment of the present invention, the recording device is 
present on a network with a confidence control imit, such as a MCU (multi conference imit) for 
example. Hereinafter, the term "conference" is used to refer to any multi-participant session, 

25 even if only two partidpants are present, one of which is the device of the present inventioa The 
conference control unit either receives a request to initiate the conference call (multimedia 
session) from the recording device of the present invention and/or from one of the participating 
IP communication devices, and/or from some other component on the network. Examples of 
such communication devices mclude, but are not limited to, IP telephony devices, "'smarf ' IP 

30 telephones and computational devices which include an IP telephony component. 

According to another optional but preferred implementation of the present invention, the 
recording device is the NiceLog™ product of Nice Systems Ltd of Ra'anana, Israel. 
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Herdnaiter, the term ''computational device" refers to any type of computer hardware 
system and/or to any ^e of software operating system, or cdhilar telephones or any type of 
hand-held device such as a PDA (personal data assistant), as well as to any type of device having 
a data processor and/or any type of microprocessor, or any type of device which is capable of 
5 performing any function of a computer. 

For the present invention, a software application or program* could be written in 
substantially any suitable programming language, which could easily be selected by one of 
ordinary skill in the art. The programming language chosen should be compatible with the 
computational device according to which the software application is executed. Examples of 
10 suitable programmmg languages mclude, but are not limited to, C, C++ and Java. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention is herein described, by way of example only, with reference to the 
accompanying drawings, wherein: 
15 FIG. 1 is a schematic block diagram of an exemplary system according to the present 

invention; 

FIG. 2 is a flowchart of an exemplary method accorduig to the present invention for 
recording and/or otherwise monitoring TP multimedia sessions; 

FIG. 3 is a flow diagram of an optional flow of operations according to the present 
20 invention; 

FIG. 4 is a schematic block diagram of a second exemplary system according to the 
present invention; and 

FIG. 5 shows a flowchart of another exemplary method according to the present 
invention, with rpgard to the implementation of the present mvention with a "hunt group*'. 

25 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention is of a system and method for recording and/or otherwise 
monitoring IP multimedia sessions. The present invention features a recording and/or monitoring 
device, referred to hereinafter as "a recording device" for the purposes of darity only and without 
30 any intention of being limiting. The recording device is a participant in the IP multimedia session, 
although preferably the recording device only receives data for recording and/or otherwise 
monitoring the session. Therefore, the IP multimedia session is preferably a multi-user session. 
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such as a "conference call" for ^cample, even if data is being provided for recording from only 
one of the participants in the sessioa 

Optionally, only a portion of all such multimedia sessions are recorded, although 
alternatively, all such sessions are recorded. The recording device may optionally receive a 
5 command for detennining when a session is to be recorded. Alternatively, the recording device 
may receive data for all such sessions, but may preferably only record certain sessions. More 
preferably, a scheduler determines whether the session should be recorded, which may optionally 
be located with the recording device but alternatively is separated on the network. 

According to a preferred embodiaient of the present mvention, the recording device is 

10 present on a network with a conference control unit, such as a MCU (multi conference unit) for 
CTcample. Hereinafter, the term '"conference" is used to refer to any multi-participant session, 
even if only two participants are present, one of which is the device of the present invention. The 
conference control unit either receives a request to initiate the conference call (multimedia 
session) from the recording device of the present invention and/or from one of the participating 

IS IP communication devices, and/or from some other component on the network. Examples of 
such communication devices mchide, but are not limited to, IP telephony devices, "smart" IP 
telephones and computational devices which include an IP telephony component. 

According to another optional but preferred implementation of the present invention, the 
recording device is the NiceLog™ product of Nice Systems Ltd of Ra'anana, Israel. 

20 According to other optional but preferred embodiments of the present invention, the IP 

multimedia session may also include one or more non-IP telephony devices, such as a telephone 
device commimicating through the PSTN (public switched telephony network). For this 
embodiment, the system of the present invention preferably features a gateway for receiving such 
commimication and for ^tabling the data to be passed to other components of the present 

25 invention, including but not limited to the recording device. 

According to another optional but preferred implementation of the present invention, the 
system and method of the present invention are enabled for "himt groups", which use a phurality 
of virtual telephone numbers rather than fixed telephone lines that are reserved for particular 
telephone numbers. Hunt groups are well kaown in the art; one example of a suitable reference is 

30 found in ''Newton's Telecom Dictionary", 16th Expanded & Updated Edition, by Harry Newton 
(published in 2000, by Telecom Books; page 414), which is incorporated by reference as if fiilly 
set forth herein Hereinafter, the term "hunt group" refers to any type of virtual or non-fixed 
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telephone eKtension systems, in which a central control unit of some type, such as the gatekeeper 
of the present invention, determines the physical extension which is used. 

The present invention may also optionally be implemented with a nimiber of well known 
protocols in the background art for multimedia IP sessions, including but not limited to H.323, 
5 RTP (real tune protocol, RTCP (real time control protocol), a225 and H.245; as well as 

CODECS for encoding/decoding the multimedia data for such sessions, inchiding but not limited 
to, G.71 1, G.723, G.722, G.728, H261 and H.263; all of which are hereby incorporated by 
reference as if My set forth hereia In addition, references may be found at 
http://www.normos.org/iete'rfc/rfcl889.txt as of August 17, 2001, which are also hereby 

10 incorporated by reference as if My set forth herein, inchiding all links and other dataAVeb pages 
found at the Web site. Further information may also be found in US Patent No. 6,122,665, issued ^ 
September 19, 2000, which is also incorporated by reference as if My set forth herein. 

The principles and operation of the method according to the present invention may be 
better understood with reference to the drawings and the accompanying description. It should be 

1 5 noted that the present invention is described with regard to IP telephony for the purposes of 
clarity only and without any intention of being limiting. 

Referring now to the drawings. Figure 1 shows an illustrative system 10 for recording 
and/or otherwise monitoring an BP conmiunication session, which may optionally be a multimedia 
session. The session may optionally be initiated at any one of an IP telephone 12 on a LAN (local 

20 area network) 14; an JP telephone 16 on a WAN (wide area network) 18; and a telephony device 
20 communicating through a PSTN (public switched telephony network) 22. Examples of suitable 
IP telephones include but are not limited to, VIP 30 or SP+12 (Cisco Inc., San Jose, California, 
USA). Preferably, the actual Handling of the session is slightiy different for each of these different 
initiating devices, as described in greater detail below. 

25 As shown, LAN 14 features a recording device 24. According to another optional but 

preferred implementation of the present invention, recordmg device 24 is the NiceLog™ product 
of Nice Systems Ltd of Ra'anana, Israel This product features a monitor for monitoring activity 
through voice telephony on an IP network. Although tiie activity is monitored through voice 
telephony protocols, other types of data may also optionally be monitored, such as video and 

30 audio data transmissions. The monitor component of the NiceLog™ product includes a 

recording function to record these voice and other types of data transmissions. For example, the 
recording function may be manually activated to start recording. Further details may be found in 
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the User's Manual of the NiceLog™ product. 

Recordmg device 24 is preferably in communication with a recording agent 26 for 
controlling the process of recording, although optionaUy both recording device 24 and recording 
agent 26 may be present in a single device, although separate devices are preferred. Alternatively, 
5 recording device 24 may optionally perform all of these fiinctions. Recording agent 26 is 
preferably operated as a software module by a computational device 28. Accordmg to the 
present invention, upon initiation of the IP multimedia session, recording agent 26 determines that 
the session has been initiated and directs recording device 24 to record the session. Optionally, 
only certain sessions are recorded. In order to support recording, the multimedia session is 
10 constructed as a conference call, and recording device 24 then becomes a participant in that 
conference call. 

Figure 1 shows one exemplary implementation for supporting tfiese functions. As shown, 
LAN 14 also optionally and preferably is connected to a conference controller 30, such as an 
MCU for example. Conference conti-oller 30 estabUshes tiie conference caU. Preferably, LAN 14 
connects to a gatekeeper 32 according to tht H.323 protocol, which translates telephone numbers 
to IP addresses, and tiierefore enables the initiating device to locate tiie otiier communication 
device (if present on LAN 14). A non-limiting example of gatekeeper 32 is tiie MCS 7820 
product (Cisco Inc., San Jose, California, USA). Gatekeeper 32 may optionaUy be assisted in 
performing IP address resolution by a DHCP server (not shown), which is connected to LAN 14. 
DHCP server assigns IP addresses to IP telephone 12 and to otiier IP telephones and devices; tiie 
assigned addresses are tiien passed to gatekeeper 32 for performing IP address resolution. 

For tiie first example of initiating device previously given, IP telephone 12 on LAN 14 
initiates tiie session, as exphmed also witii regard to the flowchart of Figure 2, showing an 
exemplary mefliod according to tiie present invention for recording and/or otiierwise monitoring 
25 IP multimedia sessions. For example, IP telephone 12 may contact gatekeeper 32 to initiate tiie 
session witii an IP telephone 34 on computational device 28 in stage 1 . Botii participants are 
therefore connected through LAN 14. 

In stage 2, tiie conti-ol path is established by gatekeeper 32, for example according to tiie 
H.323 protocol, in order for tiie IP session to be initiated. In stage 3, if recording device 24 is 
30 not present and/or operational, preferably tiie normal P communication session is enabled witii IP 
telephone 34. AJtematively, if recording device 24 is present, then recording agent 26 
preferably identifies tiie incoming request to initiate the session. 



20 



wo 02/19620 



PCT/ILOl/00805 



7 

In stage 4, a recording agent control module 36, shown with regard to Figure 1, 
preferably controls the conference call recording. Optionally and more preferably, recording 
agent control module 36 sends a request to initiate the conference call to gatekeeper 32. This 
request preferably inchides a request to mchide recording device 24 in the conference call. 

5 In stage 5, gatekeeper 32 sends a request to conference controller 30 to initiate the TP 

multimedia session, with recording device 24 as a participant thereof In stage 6, conference 
controller 30 initiates the conference call between IP telephone 12 and DP telephone 34. In stage 
7, recording device 24 is preferably added to the conference call. 

A similar operation is performed if the session is to be established with IP telephone 16 on 

10 WAN 18. As shown in Figure 1, WAN 18 is optionally connected to LAN 14 through a router 
38 (LAN 14 may optionally feature a hub 40). IP telephone 12 may again initiate the session by 
contacting gatekeeper 32; the remaining stages are performed substantially as previously 
described. Alternatively, IP telephone 16 may initiate the session. In order for IP telephone 16 to 
initiate the session and the recording, preferably IP telephone 16 features recording agmt 26 and 

15 recording agent control module 36 as part of a single device. It should be noted that only one of 
IP telephone 12 and IP telephone 16 requires recording agent 26 and recording agent control 
module 36, operated directly by the BP telephone itself (in the case of a "smart telephone"), or 
alternatively operated by a computational device which also operates the IP telephone, in order 
for the session to be recorded. 

20 The operation is preferably adjusted somewhat if a telephony device 20 communicating 

through a PSTN 22 is contacted by IP telephone 12 to initiate the multimedia call and/or if 
telephony device 20 initiates the call. In both cases, communication to and from telephony device 
20 passes through a gateway 42, for ©cample in order to translate regular PSTN 22 
communication to IP-based communication, such as H.323 protocol-based communication for 

25 example. Gateway 42 then preferably contacts gatekeeper 32 in order for telephony device 20 to 
be recognized as a participant in the session. The rem£umng fimctions. are sunUar to those shown 
in Figure 2. Gateway 42 may optionally be implemented as a Cisco Internet Router 3620, for 
example (Cisco Inc., San Jose, California, USA). 

Figure 3 shows a flow diagram of an optional flow of operations according to the present 

30 invention. As shown, IP telephone 12 initiates tiie session, through gatekeeper 32, to IP 

telephone 34. The session is implemented as a conference call. Conference controller 30 enables 
recording device 24 to participate in the conference call, as well as preferably enabling the 
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cofi&reace call itself. It should be noted that typically that only infonnation passing through 
arrows '"A" and '"B", from each of IP telephone 12 and IP telephone 34 respectively, is recorded. 
Also, optionally and pr^erably, recording device 24 only receives communication through arrow 

5 For this implementation, recording device 24 preferably has at least on^ and more 

preferably a plurality of, reserved telephone numbers which correspond to actual telephone lines. 
Video and/or audio data may optionally be captured according to the RTP (real time protocol) 
protocoL 

Figure 4 shows another exemplary system 44 according to the present invention for 
10 selective recording of sessions. Similar components to Figure 1 retain the same numbering. 
Now, recording device 24 is preferably contained within a selective recorder 46, which also 
features a scheduler 48. Scheduler 48 may optionally be manual or automatic. For the latter 
implementation, scheduler 48 may optionally analyze information about the IP multimedia 
session, such as the identity of the initiating and/or recdving device, in order to determine 
15 whether the session should be recorded. For the manual implementation, the user at the receiving 
and/or initiating IP telephony device may optionally determine whether the session should be 
recorded. 

Figure 5 shows a flowchart of another exemplary method according to the present 
invention, with regard to the implementation of the present invention with a "'hunt group". As 
20 previously described, bunt groups use a plurality of virtual telephone mmibers rather than fixed 
telephone lines that are reserved for particular telephone numbers. The present invention 
supports recording and/or otherwise monitoring IP multimedia sessions with such hunt groups as 
shown in Figure 5. 

This preferred method is similar to that of Figure 2 for stages 1-4. In stage 5, however, 
25 the gatekeeper identifies the hunt group which has been called. 

In stage 6, the gatekeeper searches for a firee telephone line within that particular hunt 
group. In stage 7, the conference call is established through the conference controller, and the 
recording device joins the conference call in stage 8, as previously described. 

According to optional but preferred implementations of the present invention, any of the 
30 above embodiments may be optionally implemented with a "smart" telephone device in place of 
the computational device for operating the recording agent and/or the recording agent control 
module 36. 
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While the invention has been described with respect to a limited number of embodiments, 
it will be appredated that many variations, modifications and other applications of the invention 
may be made. 
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WHAT IS CLAIMED IS: 

1 . A method for recording a data session through a network by a recording device, 
comprising: 

initiating the data session by a first communication device; 

implementing the data session as a conference call in response to initiating the data 

session; 

entering the recording device to said conference call as a participant; and 
recordmg the data session through said conference call. 

2. The method of claim 1, wherein only said first communication device and said 
recorcUng device participate in said conference call 

3. The method of claim 1, wherein the data session is an IP telephony session. 

4. The method ofclaiml, wherein the data session is an IP multimedia session. ' 

5. The method of claims 3 or 4, wherein said first communication device contacts the 
recording device. 

6. The method of claims 3 or 4, wherein initiating the data session is detected by a 
recording agent, and said recording agent contacts the recording device. 

7. The method of claim 6, wherein a conference controller impl^ents said 
conference call. 

8. The method of claim 7, wherem said conference controller is a MCU. 

9. The method of any of chums 4-8, wherein said first communication device is a 
gateway for receiving communication through a PSTN (public s^^tched telephony network). 



10. The method of any of claims 1-9, wherein the recording device joins the data 
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session through a hunt group. 



11. A system for recording an IP conununication session through an IP network, 
comprismg: 

(a) a first communication device for mitiating the IP communication session; 

(b) a conference controller for in]^lementing a conference call with said first 
communication device for the IP communication session; and 

(c) a recording device for participating in said conference call to record the TP 
communication session. 

12. The system of claim 1 1 , fiirther comprising a second communication device for 
partidpadng in the IP coiomunication session through said conference call, wherein said first 
communication device is located on a separate network portion firom said second communication 
device. 



13. The system of claim 12, wherein said separate network portion is a dififorent 
network segment. 

14. The system of claim 12, wherein said separate network portion is a different 
network. 



15. The system of claim 1 1, wherein said recording device is the NiceLog™ product. 

1 6. The system of claun 1 1, fiirther comprising: 

(d) a gatekeeper for receiving said request firom said first communication device to 
initiate the P communication session and for sending a request to said conference 
controller to initiate said conference call 

17. The system of claim 16, fiirther comprising: 

(e) a recording agent for controlling said recording device. 

18. The system of claim 1 7, wherein said recording device and said recording agent 
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are implemented in a single device. 

19. The system of claims 17 or 18, further comprising: 

(f) a recordmg agent control module for initiating participation of said recording 
device in said confidence call. 

20. The system of any of claims 16-19, further comprising a telephone device 
connected to said gatekeeper through a PSTN (public switched telephony network) for 
participating in the IP communication session. 

21 . The system of any of clauns 1 1-20, further comprising a scheduler for determining 
whether the IP communication session is recorded, said scheduler controlling sdd recording 
device. 

22. The system of any of claims 11-21, wherem said conference controller is a MCU. 
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(57) Abstract: A system and method for recording and/or otherwise monitoring IP multimedia sessions. The present invention 
2 features a recording and/or monitoring device, referred to hereinafter as "a recording device" for the purposes of clarity only and 

without any intendon of being lioiidng. The recording device is a participant in the IP multimedia session, although preferably the 
Q recording device only receives data for recording and/or otherwise monitoring the session. Therefore, the IP multimedia session is 
^ preferably a muld-user session, such as a "conference call'* for example, even if data is being provided for recording from only one 
^ of the participants in the session. 
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